TOUCH INTERFACE FOR THE FLIGHT MANAGEMENT SYSTEM OF AN AIRCRAFT

专利摘要:
The present invention relates to a graphical interaction method for controlling an aircraft comprising the steps of receiving indication of a selected object on a display screen of the aircraft; determine one or more aircraft flight plan revisions associated with the selected object and display one or more of said flight plan revisions; receive indication of a selection of a displayed revision; determine a revision type associated with the displayed and selected revision; and depending on the type of revision determined, display a graphic symbol for data entry by touch interface. Developments concern in particular the symbology used, the validation or the modification of a selected revision, the taking into account of the flight context, the taking into account of the handling speed of the tactile interface, etc. System and software aspects are described. In particular, the human-machine interface can be exclusively of touch type.
公开号:FR3027127A1
申请号:FR1402278
申请日:2014-10-10
公开日:2016-04-15
发明作者:Francois Coulmeau；Frederic Bonamy；Patrick Mazoyer
申请人:Thales SA；
IPC主号:

专利说明:

[0001] FIELD OF THE INVENTION In general, the invention relates to human-machine interaction techniques for piloting an aircraft. In particular, the invention relates to an interactive and tactile interface for controlling an on-board real-time flight management system (FMS). State of the art In general, the interactive or touch screens available in known or commercialized aircraft do not provide a complete and satisfactory tactile interaction for managing flight management system (FMS) revisions. On A320, A330, A340, B737 / 747 aircraft, man-machine interactions are usually performed using a non-interactive display screen and from an alphanumeric keypad on a interface called MCDU (Multi Purpose Control Display). This method is tedious and imprecise. On newer aircraft (A380, A350, B777, B787) and on business aircraft (Falcon for example), pointing devices have been introduced but the associated interactions are laborious and limited. On some more recent aircraft or helicopters, interactive or tactile screens allow the pilot to define or modify the flight paths. The techniques used, however, remain limited and not very ergonomic (where appropriate the modifications are indirect, for example). The pilot must "juggle" with several input means to make a modification of the flight plan. For example, it must repeatedly enter angle values until it converges to the desired result. This manipulation is tedious. According to some known tactile systems, the pilot can tactily determine a point on the screen, which opens a dialog to select a revision, but he must then insert alphanumeric parameters corresponding to the revision 3027127 2 in question via a keyboard , that is, another input device. Other known systems require the use of two separate screens. In itself, the repetition of tedious operations can lead to a cognitive overload of the pilot, detrimental to his fatigue and thus to the safety of the flight. In certain situations, the rigidities of the existing systems can go so far as to discourage changes in the trajectories. In reality, according to these known systems, the tactile interaction is currently used only to substitute for a cursor or mouse interaction. A rich and avionics-specific tactile interaction has not been documented or implemented yet.
[0002] The US patent application US7162335 entitled "GRAPHIC AIRWAYS DISPLAY FOR FLIGHT MANAGEMENT SYSTEM" discloses a graphic flight plan construction system to Navigation Display which aims to avoid alphanumeric field entries. In particular, the document teaches the use of a device called CCD or "on-screen marker" to select elements of a navigation database. This approach has limitations. There is a need in the industry for methods and systems for advanced touch-sensitive interfaces - specific to avionics. SUMMARY OF THE INVENTION The present invention relates to a graphical interaction method for controlling an aircraft comprising the steps of receiving indication of a selected object on a display screen of the aircraft; determine one or more aircraft flight plan revisions associated with the selected object and display one or more of said flight plan revisions; receive indication of a selection of a displayed revision; determine a type of revision associated with the displayed and selected revision; and depending on the type of revision determined, display a graphic symbol for data entry by touch interface. Developments concern in particular the symbology used, the validation or the modification of a selected revision, the taking into account of the flight context, the taking into account of the handling speed of the tactile interface, etc. System and software aspects are described. In particular, the human-machine interface can be exclusively of touch type.
[0003] A method (computer-implemented) of graphical interaction for piloting an aircraft is disclosed comprising the steps of receiving indication of a selected object on a display screen of the aircraft; determining one or more aircraft flight plan revisions associated with the selected object and displaying one or more of said flight plan revisions; receive indication of a selection of a displayed revision; determine a revision type associated with the displayed and selected revision; and, depending on the type of revision determined, display a graphic symbol for data entry by touch interface; said graphical data entry symbol being selected from or among a symbology comprising a plurality of graphical data entry symbols. An object or point or area or portion of the display is determined or selected or indicated, for example by providing the spatial coordinates of that point (in space or on the display screen). For example tactile interface means, possibly "multitouch" may determine said display portion. In one embodiment, a single display portion is indicated. In one embodiment, a plurality of display points are indicated. From or according to this or these display portion, one or more eligible revisions are determined. This determination can be made in different ways. The determination step may be static, that is to say, result from the application of predefined tables, associating, for example, selection zone, associated actions, alphanumerical input mode and, if necessary, an input mode. alternative graph. Following the determination of one or more eligible revisions, the pilot selects a particular revision. A type of revision associated with this displayed and selected revision is then determined. Depending on the type of revision determined, a graphical data entry symbol is displayed by touch interface; said graphic symbol being selected in a symbology comprising a plurality of graphic symbols. The term "symbology" generically refers to a family or class of symbols (which as modes of data representation may include a very large number of specific variants). The term "symbology" is generally used later to connote and emphasize the idea of class.
[0004] The determination of the symbology to be applied (i.e. the choice of a particular symbol) may include including steps of determining several "elementary" substitution patterns and then synthesizing said elementary substitution patterns according to predefined criteria. In one embodiment, several basic substitution patterns are determined (e.g., based on pilot action and / or flight context, etc.). The various elementary substitution models are then evaluated and / or weighted, based on predefined criteria, to finally be concatenated or aggregated or synthesized in a final substitution model (ie, which will be displayed to the pilot). In other words, the various elementary substitution models correspond to intermediate levels of abstraction, which remain entirely optional (the corresponding operations are calculation operations that are transparent for the pilot who only perceives the mode of interaction. final). For example, the symbology (ie the determined interaction model) to be applied to / on a revision may be one or the other of the following models: a) the application of a "mono-data" model eg the unitary model corresponding to the parameter manipulated for alphanumeric single-entry families, or b) the application of a "multi-data model" eg a superimposition of unitary models for families with multi-alphanumeric input or c) the application of a "pure graphical model" eg a lat / long model for families without alphanumeric input linked to points on a lateral representation. In some embodiments, there may be no choice of interaction mode, i.e. a single graphical interactive symbol is displayed. Optionally and optionally, a choice can be made between different modes of interaction that can be envisaged in order to carry out the revision associated with the determined object. This choice may in particular be materialized by the display of various interactive graphic symbols. Various interactive graphic symbologies are described below. In one embodiment, each interaction model can be associated with one or more actions, each action can be associated with an alphanumeric input mode with possibly its correspondence in terms of graphical input.
[0005] In a development, the method further comprises a step of receiving one or more data as a result of the manipulation of the graphical data entry symbol.
[0006] The data are alphanumeric values, for example. In one embodiment, the method captures the actions on the model and derives modified alphanumeric parameters therefrom. In one development, the method further comprises a step of modifying one or more of the received data. The method can in particular carry out conversions of units of measurement. In a development, the method further comprises a step of validating the selected revision. The method can activate or validate the revision called "heart" for example with alphanumeric parameters or selected values, possibly modified. The method can then check the relevance of the elementary models following the revision. In one embodiment, the steps are repeated, for example until the revision is confirmed. In a development, the method further comprises a step of modifying the selected revision.
[0007] In addition, the method can correct in some cases the revision considered. In one development, the method further includes a step of changing the display of the graphical data entry symbol based on parameters including a measure of the pilot's cognitive load and / or the flight context of the aircraft.
[0008] According to one aspect of the invention, in correspondence with each pilot action in interaction with the FMS (eg an action can be a "revision", for example of the flight plan), the keyboard entries are replaced by graphic selections rendering - in whole or in part - the same service, and in particular can be contextualized and / or optimized to match the most likely intent of the pilot.
[0009] The symbols used are particularly suitable for unitary revisions, but also for multiple revisions (e.g. via symbol overlay). In addition, the symbols used can be modified in real time, in particular to adapt to the type of revision in progress. Advantageously, the semiology or "symbology" may change (i.e. be modified or adapted), for example in real time to suit the type of revision or piloting action in progress.
[0010] In a development, the step of displaying the graphical data entry symbol includes a step of spatially and / or temporally distributing said display. The display of one or more symbols may be optimized (i.e. adapted, for example, to the current revision and / or the flight context). Specifically, the selected interaction model (translated by the display of corresponding graphical symbols) can be distributed on the different screens in an optimized manner (e.g. distribution or spatial distribution of information on the different screens available and / or accessible). For example, in terms of space, the display may be split or split or distributed among several display devices, if any. For example, optionally, the method may shift or move graphically, for example during the time of entry, the entire display to allow the substitution model to display at the boundaries of this display area. The display of the value may for example be carried out at different places in the pilot's visual field, for example near the means of revision 15 (finger, cursor) or at other places in the cockpit (head-up projection, augmented reality type overlay, 3D rendering etc.). In temporal matter, the graphic symbol may comprise display sequences ordered in various ways. In one development, the method further comprises a step of receiving or determining a parameter associated with the indication of the selected object on the aircraft display screen. In a development, the step of determining one or more revisions of the flight plan of the aircraft associated with the selected object is a function of said parameter associated with the indication of the selected object. In a development, the step of determining and / or displaying a graphical data entry symbol by touch interface is a function of said parameter associated with the indication of the selected object. For example, the associated parameter may correspond to the measurement of a speed of movement of the pilot's finger on the touch interface (in this case the parameter is determined or measured). It can also be (directly or indirectly) received a numerical value for example by voice command or by touch control or by logic command or by network command or by physical wheel or by mouse cursor or by eye movement (eg eye tracking) .
[0011] The numerical value thus determined (by calculation or received) can be interpreted (for example) as an intensity influencing the degree or the interaction modalities for the input (alphanumeric and / or graphical), impacting for example the determination of the revisions and / or types of these revisions and / or the choice of the data entry symbol or symbols. For example, during turbulence causing the trembling of the hand of the pilot, this or that mode of interaction may be preferred. Regarding the aspects specific to the management of the touch interface, the management algorithms of the movement of the finger (or the cursor or pointing device) may in particular be a function of different parameters. The algorithms may in particular be a function of the speed of movement of the latter over the tactile interface (for example a speed determined to be high may reflect a certain readiness of the pilot and / or an emergency situation and / or a necessity less or less accurate return of results). The algorithms can also be function of other objects, for example those close to the selection. The algorithms may also be a function of the displayed or current trajectory. They may also be functions of rounding and / or units corresponding to the current revision (for example by integer FL - or 100 ft - for altitudes). They can be a function of the display range, the type of representation (2D ND, 2D VD, 3D, 2.5D ...), etc. In a development, the step of determining and / or displaying a graphical data entry symbol by touch interface is a function of one or more parameters comprising a) the number of data to be entered b) the type of revision to achieve, c) the type of unit of the input d) the display range e) the type of representation and / or f) one or more predefined criteria. There is disclosed a system comprising means for carrying out one or more steps of the method according to the invention. In general, the system or device may comprise a processor or calculation means, a memory or storage means and HMI man-machine interface means. In particular, the invention makes possible embodiments entirely - and exclusively - with tactile interface. Advantageously, the alphanumeric input modes can be completely replaced by graphical FMS input modes. In a development, the system comprises a PFD main display screen and / or a display screen. ND / VD navigation and / or MFD multifunction display. In a development, the system comprises avionics flight management system Flight Management System and / or non-avionic means Electronic Flight Bag type (or "electronic bag") and / or augmented reality means and / or virtual. The AR means in particular comprise systems of HUD type ("Head Up Display" referred head high) and the VR means include in particular systems of the type EVS ("Enhanced Vision System") or SVS ("Synthetic Vision System"). In a development, the system exclusively comprises touch-type interface means. In a particular embodiment of the invention, the cockpit is fully tactile, i.e. exclusively consisting of touch-type HMI interfaces. The methods and systems according to the invention in fact allow "all-tactile" embodiments (for example an FMS interface within the piloting cockpit will be of the "all-touch" type), that is to say according to a human-machine interaction environment consisting entirely of touch screens, without any tangible actuator but advantageously fully reconfigurable. It is indeed possible to manage all (i.e. completeness without exception) multi-parameter revisions in a tactile way (because of the approach allowing superimposing interactive graphic symbols). It is therefore possible to completely eliminate keyboard entries. In the absence of a "all touch" embodiment, the methods and systems according to the invention allow a drastic and advantageous reduction of alphanumeric keyboard inputs. In general, one aspect of the invention aims to define an "FMS substitution language" which makes it possible to manipulate all possible FMS revisions according to one or more adapted models (by means of graphical symbols corresponding to the business aspects). This language is reflected in particular by the existence of predefined rules and parameters for managing the human-machine interaction (e.g. steps of substituting a non-tactile basic task for an equivalent task in a tactile manner). The invention aims in particular to control the flight management system or FMS "finger", that is to say using a touch screen, exclusively or in combination with non-touch interfaces.
[0012] According to one aspect of the invention, it is possible to dispense alphanumeric keyboard input or at least reduce the use of non-tactile interfaces. According to one aspect of the invention, the alphanumeric entries are replaced by direct selection functions on the object to be modified, not involving these keyboard entries or at least by replacing some of these entries by their tactile counterparts. Advantageously, according to one embodiment, the invention makes it possible to dispense with an alphanumeric keyboard and / or the need to use an additional input device. Advantageously, according to one embodiment, the invention makes it possible to interact completely graphically, at the very least by drastically limiting any recourse to alphanumeric input. In one embodiment, the selection means can be continuously or continuously adapted to allow precise selection of the value to be entered. A fluidity of input can thus be ensured for the crew who can generally see instantly the result of their actions, as and when the manipulation of the touch interface, for example without ever having to make an entry alphanumeric head down. According to various embodiments, the method allows alphanumeric input or input modes, in particular by using exclusively one or more tactile interfaces. Advantageously, these data inputs are fast and intuitive. Some embodiments may, however, use "hybrid" i.e. interfaces 20 combining touch and non-touch interfaces (keyboard, cursor, mouse, trackball, trackpad, haptic system, voice control, eye-tracking control, etc.). Advantageously, according to embodiments of the invention, models of human-machine interactions by touch interface specific to avionics (that is to say, adapted to control environments) can be implemented. In other words, the developments of the invention go beyond a simple transposition of tactile technology to avionic environments, but on the contrary, it is a matter of redesigning the interaction of the pilot with the management system of the aircraft. flight. The ergonomics of the human-machine interaction within the FMS can indeed be redesigned in depth (e.g., to optimize the capture of information directly on the screen). For example, embodiments of the invention make it possible to develop new transfer functions (for example "Design / Alphanumeric", optimized to deal with the particularities of an embedded system at the heart of the FMS core business). The transformation (partial or total) of tangible elements - thus by definition rigid or invariant - in logic / logical equivalents allows greater flexibility in the implementations (beyond the only reconfiguration of the cockpits, ie taking into account context for the display and manipulation of data, personalization of data and / or means of action, interfaces becoming programmable and / or configurable).
[0013] Advantageously, the method according to the invention is generally backwards compatible. Several developments of the method according to the invention notably describe input modes by means of "graphic boxes" represented on the screen which display the final numerical or symbolic values, as modified by the pilot and / or the flight management system. . Several types of graphic boxes exist, including "distance", 10 "angle", "altitude", "speed", "mass", "centering", etc. Optionally, a click (with the finger or the cursor) in a box makes it possible to enter on a keyboard the desired values. This makes it possible to remain compatible with the interactions currently implemented in the aircraft marketed. The functions requiring an alphanumeric calculation always propose to materialize a window on the screen, in which the crew enters their data using an alphanumeric keyboard. If the technical solution proposed by the invention is implementable or exploitable on touch-type interfaces, it is so also with the current systems of interactivity by cursor. The method allows the definition and use of new functions within the flight management system. For example, new functions may be associated with a revision, in particular by allowing an alphanumeric value to be selected without the need to enter it on a keyboard, but by directly manipulating new symbols associated with said revision. Certain embodiments of the method according to the invention make it possible to integrate new functions into the FMS flight management systems (calculations of angles, distances, altitude deviations, card rotations, revision on another element as the FMS, for example an aircraft displayed on the screen by the TCAS function, a terrain or weather hazard displayed on the screen). The method according to the invention also allows advanced bypass functions (entry of the bypass skeleton by simple touch commands, input or entry of the value of the offset to avoid the hazard by manipulating eg by "pulling" the trajectory obtained, etc.).
[0014] Finally, the method also makes it possible to consider one or more actions on parameters such as speed, by acting on the airplane model, or on a trajectory element (eg action on RTA by clock type pattern, chronometer or hourglass, etc. ). Finally, the method can be used in a "Vertical Display" context (i.e. the pendant of the vertical display). For example, in one embodiment it is possible to modify in real time the vertical trajectory (displacement of pseudo "waypoints", displacement of altitude constraints or speed or time, etc.). It is also conceivable to create a library of tactile and / or gestural commands ("gesture") in particular for the "reversal" of the card, allowing the pilot to apply card rotations to perceive his environment in the lateral plane or vertical (or three-quarters). Finally, the method according to the invention allows new interactions (for example a "DIRECT TO" function with an alignment on the following leg). The method of the invention will advantageously be implemented in a wide variety of avionics systems and environments. The method can be carried out on board, between an interactive interface (tactile or not) on the one hand, and an FMS (or an EFB, a tablet, etc.) or an FWS (for example to tick or select boxes or options) or on the ground (for example in an air traffic control HMI for example or in airline software). The invention will also advantageously be applicable for seizures of aeronautical routes, for example of TAXI type (airport taxiing system). Advantageously, finally, the invention will find application in a tele-driving cabin of a drone. DESCRIPTION OF THE FIGURES Various aspects and advantages of the invention will appear in support of the description of a preferred mode of implementation of the invention, but without limitation, with reference to the figures below: FIG. overall technique of the invention; Figure 2 schematically illustrates the structure and functions of a known FMS flight management system; Figure 3 shows examples of steps according to a method of the invention; Figure 4 shows examples of revisions and business parameters; Figures 5 to 11 show different examples of symbologies according to the invention; Figure 12 illustrates the superposition of different symbologies on a display screen of the FMS; FIG. 13 illustrates various aspects relating to the HMI human-machine interfaces for implementing the method according to the invention. DETAILED DESCRIPTION OF THE INVENTION Certain terms and technical environments are defined below. The acronym or acronym FMS corresponds to the English terminology "Flight Management System" and refers to aircraft flight management systems, known in the state of the art by the international standard ARINC 702. During the preparation of a During the flight or during a diversion, the crew enters various information relating to the progress of the flight, typically using a flight management device of an FMS aircraft. An FMS comprises input means and display means, as well as calculation means. An operator, for example the pilot or the co-pilot, can enter via the input means information such as RTAs, or "waypoints", associated with waypoints, that is to say points on the vertical of which the aircraft must pass. These elements are known in the state of the art by the international standard ARINC 424. The calculation means make it possible in particular to calculate, from the flight plan comprising the list of waypoints, the trajectory of the aircraft, as a function of geometry between waypoints and / or altitude and speed conditions. In the remainder of the document, the acronym FMD is used to designate the textual display of the FMS present in the cockpit, generally arranged at a low head (at the pilot's knees). The FMD is organized into "pages" which are functional groupings of consistent information. Among these pages are the page "FPLN" which presents the list of the elements of the flight plan (waypoints, markers, pseudo waypoints) and the page "DUPLICATE" which presents the results of searches in the navigation database. The acronym ND is used to designate the graphical display of the FMS present in the cockpit, usually arranged in the middle head, in front of the face. This display is defined by a reference point (centered or at the bottom of the display) and a range, defining the size of the display area.
[0015] 3027127 13 The acronym HMI corresponds to Human Machine Interface (HMI). The entry of information, and the display of information entered or calculated by the display means, constitute such a man-machine interface. With known FMS-type devices, when the operator enters a waypoint, he does so via a dedicated display displayed by the display means. This display may optionally also display information relating to the time situation of the aircraft vis-à-vis the waypoint considered. The operator can then enter and visualize a time constraint posed for this waypoint. In general, the HMI means allow the entry and the consultation of the flight plan information. Figure 1 illustrates the overall technical environment of the invention. Avionics equipment or airport means 100 (for example a control tower in connection with the air traffic control systems) are in communication with an aircraft 110. An aircraft is a means of transport capable of evolving within the earth's atmosphere. .
[0016] For example, an aircraft can be an airplane or a helicopter (or even a drone) The aircraft comprises a cockpit or a cockpit 120. Within the cockpit are flying equipment 121 (called avionic equipment), comprising, for example, one or more on-board computers (means for calculating, storing and storing data), including an FMS, means for displaying or viewing and entering data, communication means, as well as ( possibly) haptic feedback means and a running computer A touch pad or an EFB 122 can be on board, portable or integrated in the cockpit, said EFB can interact (two-way communication 123) with the avionic equipment 121. The EFB may also be in communication 124 with external computing resources, accessible through the network (eg cloud computing or "cloud computing" 125. In particular, can be carried out locally on the EFB or partially or totally in the calculation means accessible by the network. The on-board equipment 121 is generally certified and regulated while the EFB 122 and the connected computer means 125 are generally not (or to a lesser extent).
[0017] This architecture makes it possible to inject flexibility on the side of the EFB 122 while ensuring controlled safety on the side of the on-board avionics 121. Among the on-board equipment are various screens. The ND screens (graphic display associated with the FMS) are generally arranged in the primary field of view, while the FMDs are positioned in "head down". All information entered or calculated by the FMS is grouped on pages called FMD. The existing systems make it possible to navigate from page to page, but the size of the screens and the need not to put too much information on a page for its readability do not make it possible to comprehensively understand the current and future situation of the flight. in a synthetic way. The crews of modern aircrafts in cabin are usually two people, distributed on each side of the cabin: a "pilot" side and a "co-pilot" side. Business aircraft sometimes have only one pilot, and some older aircraft or military transport have a crew of three. Each visualizes on his HMI pages that interest him. Two pages of the hundred or so possible are usually displayed permanently during the execution of the mission: the page "flight plan" first, which contains the route information followed by the aircraft (list of next points of passage with their predictions associated in distance, time, altitude, speed, fuel, wind). The route is divided into procedures, themselves consisting of points 15 (as described in patent FR2910678) and the "performance" page afterwards, which contains the parameters useful for guiding the aircraft on the short term (speed to follow, ceilings d altitude, next changes of altitude). There are also a multitude of other pages available onboard (the side and vertical review pages, the information pages, pages specific to certain aircraft), or generally a hundred pages. Figure 2 schematically illustrates the structure and functions of a known FMS flight management system. An FMS 200 type system disposed in the cockpit 120 and the avionics means 121 has a man-machine interface 220 comprising input means, for example formed by a keyboard, and display means, for example formed by a display screen, or simply a touch display screen, and at least the following functions: - Navigation (LOCNAV) 201, to perform the optimal location of the aircraft according to the geolocation means such as the geo-positioning by satellite or GPS, GALILEO, VHF radionavigation beacons, inertial units. This module 30 communicates with the aforementioned geolocation devices; - Flight plan (FPLN) 202, to enter the geographical elements constituting the "skeleton" of the route to be followed, such as the points imposed by the departure procedures 3027127 15 and arrival, the waypoints, the air corridors , commonly referred to as "airways" according to English terminology. An FMS generally hosts several flight plans (the so-called "Active" flight plan on which the aircraft is guided, the "temporary" flight plan allowing modifications to be made without activating the guidance on this flight plan and 5 "Inactive" work planes (so-called "secondary") - Navigation database (NAVDB) 203, to build geographic routes and procedures from data included in the bases relating to points, tags, legacies interception or altitude, etc. - Performance database, (PERFDB) 204, containing the aerodynamic and engine parameters of the aircraft - Lateral trajectory (TRAJ) 205, to construct a continuous trajectory from the flight plan points, respecting aircraft performance and containment constraints (RNAV for Area Navigation or RNP for Required Navigation Performance); 15 - Predictions (PRED) 206, to build an optimized vertical profile on the lateral trajectory and vertical and giving the estimates of distance, time, altitude, speed, fuel and wind in particular at each point, at each change of pilot parameter and destination, which will be displayed to the crew. The disclosed methods and systems affect or concern this portion of the calculator. 20 - Guidance (GUID) 207, for guiding the aircraft in its lateral and vertical planes on its three-dimensional trajectory, while optimizing its speed, with the aid of the information calculated by the Predictions function 206. In an aircraft equipped with a automatic control device 210, the latter can exchange information with the guide module 207; 25 - Digital data link (DATALINK) 208 for exchanging flight information between flight plan / prediction functions and control centers or other aircraft 209. - one or more HMI screens 220. All the information entered or calculated by the FMS is grouped on display screens (FMD, NTD and PFD pages, HUD or other). On airliners type A320 or A380, the trajectory of the FMS is displayed in an average head, on a display screen said Navigation Display (ND). "Navigation display" provides a geographical view of the aircraft's situation, with the display of a cartographic background (whose exact nature, appearance, content may vary), sometimes with the flight plan of the aircraft. plane, the characteristic points of the mission (point equi-time, 5 end of climb, beginning of descent, ...), the surrounding traffic, the weather in its various aspects such as the winds, the storms, the zones of icing conditions, etc. On the A320, A330, A340 and B737 / 747 aircraft, there is no interactivity with the flight plan display screen. The construction of the flight plan is done from an alphanumeric keyboard on an interface called MCDU (Multi Purpose Control Display). The flight plan is constructed by entering the list of "waypoints" represented in tabular form. One can enter a certain amount of information on these "waypoints", via the keyboard, such as the constraints (speed, altitude) that the plane must respect when passing waypoints. This solution has several defects. It does not allow to deform the trajectory directly, it is necessary to pass by a successive entry of 15 "waypoints", either existing in the databases of navigation (NAVDB standardized on board in format AEEC ARINC 424), or created by the crew via its MCDU (by entering coordinates for example). This method is tedious and imprecise given the size of the current display screens and their resolution. For each modification (for example a deformation of the trajectory to avoid a dangerous weather hazard, which moves), it may be necessary to re-enter a succession of waypoints outside the zone in question. From the flight plan defined by the pilot (list of waypoints called "waypoints"), the lateral trajectory is calculated according to the geometry between the crossing points (commonly called LEG) and / or altitude conditions and speed (which are used for calculating the turning radius). On this lateral trajectory, the FMS optimizes a vertical trajectory (in altitude and speed), passing through possible constraints of altitude, speed, time. All the information entered or calculated by the FMS is grouped on display screens (MFD pages, NTD and PFD visues, HUD or other). The MMI part of FIG. 2 therefore comprises a) the FMS HMI component which structures the data for sending to the display screens (known as CDSs for the Cockpit Display system) and b) the CDS itself, representing the screen and its graphics management software, which displays the drawing of the trajectory, and which also includes the drivers 3027127 17 for identifying the movements of the finger (in the case of a touch interface) or the pointing device. FIG. 3 shows examples of steps of the method according to the invention. A general prior step is to establish substitution typing templates 300, which can replace (in whole or in part) alphanumeric keyboard or tangible input operations with data entry operations. a touch device. In a first step 300, possibly carried out beforehand, the method according to the invention can thus proceed to the establishment of one or more substitution models 300. The substitution models correspond to "trades" of the system of substitution. FMS flight management. These models can be optimized by type of revision (e.g. by type of act or action or command or instruction or order). Step 300 may include, in particular, a step of constructing a database (or "business knowledge" database) comprising graphical (interaction) models responding, for example for each known FMS revision, to all of the possible alphanumeric actions on said revision. By using the specifics of these FMS revisions as defined, it is possible to create a graphical specific language (DSL). In these preliminary steps, the parameters involved in the FMS revisions are characterized. The method may for example determine a set of patterns (or "patterns") of substitution for the alphanumeric selection to be applied for a given revision. Said models can for example be a function of the a) number of data to be entered or entered, b) the typicity of the FMS revision to be performed, c) the units of the parameters, d) the display range, e) the type of representation or (f) other generally defined criteria. The links or associations between these patterns and the possible or resulting alphanumeric values may be configurable. In step 321, an object manipulated on the screen is determined (or a display portion of the screen). The portion may be square or rectangular or any other geometric shape. The display portion may also be irregularly shaped, i.e. non-geometric. In particular, the display portion may be received from an external analysis module. Several options for naming or selecting or indicating an object on the screen (or a display area) are possible.
[0018] In step 322, associated with the determined object, a revision is selected. It is therefore made a choice by the pilot as to the desired revision on the determined object. For example, on an object, an optional list (drop-down or otherwise) allows the pilot to select the revision that is to be made on the object, from the list of revisions 5 proposed at the step in question. Filtering can only display eligible revisions on the object. For example, if the selected object is the "arrival track", revisions like "DIRECT" or "HOLD" may be proposed, but not necessarily the entry of an "altitude constraint" or "speed" . According to one option, the "Revision" menu of the FMS is used systematically. According to another option, the different possible interactions will be displayed directly. According to another option, a combination of direct and indirect interactions will be materialized and proposed to the pilot. According to the second option, the method according to the invention proposes in addition to the review menu, all possible interaction choices directly on the object according to its nature. In step 323, the type of the selected revision is determined. The various revisions 15 can indeed be classified by type. A restricted family number is used to define and base the interaction model substitution. The benefits of a small model include limiting the learning and handling burden, improving the intuitiveness of the interface, and integrating new and future features into this model. In one embodiment, the method classifies the revisions into sub-families (of which Figure 4 shows some examples). In step 324, from the type of revision that has been determined, a substitution interaction model is determined and then optimized and / or applied. In step 324, when a revision on the screen (or on another screen) is selected, and then the type of said revision is determined, the method according to the invention then determines the HMI interaction model on the screen. more adapted (ie adapted to the revision in progress) and positions this model selected on the different screens in an optimized way (eg distribution or spatial distribution of information on the different screens available and / or accessible). The optimization can take into account in particular the current "range" (ie the digital terminals) and / or the type of representation (for example, the modification of a lateral data on a vertical representation will be modeled differently from a modification of this same lateral data on a lateral representation). The implementation of the interaction model can be carried out according to different temporalities. In one embodiment, the model is applied after the selection of the object (eg indication of a display area), eg according to its particularities (requirements and / or interaction constraints, such as predefined for example). In one embodiment, the template is applied or implemented at the time when after selecting a revision associated with the object or display area. The management of the possible overloading of the display by superimposed symbols can be managed or optimized by a regulator module, for example external ("display watchdog"). This display overload situation can occur especially if the selected object is substantially modified (in frequency and / or in number of modifications). The substitution model as determined is applied to the revision as previously determined. For example, the model to be applied to a revision will be: a) the application of a given mono model eg the unit model corresponding to the parameter used for families with alphanumeric mono input (step 2.4a or 3241), or b) l application of a multi-data model eg a superposition of unitary models for families with multi-alphanumerical input (step 2.4 or 3242) or c) the application of a pure graphical model eg a lat / long model for families without alphanumeric entry related to points on a lateral representation (step 2.4c or 3243). Concretely, in step 324, the method displays one or more graphic symbols, chosen from among predefined symbologies, corresponding to the type of revision determined on the basis of the selected revision.
[0019] The term "symbology" generically refers to a family or class of symbols (which as modes of representing the data may comprise a very large number of specific variants). The term "symbology" is generally used later to connote and emphasize the idea of class. In some embodiments, there may be no choice of interaction mode, i.e. a single graphical interactive symbol is displayed. Optionally and optionally, a choice can be made between different modes of interaction that can be envisaged in order to carry out the revision associated with the determined object. This choice can in particular be materialized by the display of various interactive graphic symbols. Various interactive graphic symbologies are described below.
[0020] In step 331, after displaying a graphic symbology (e.g., of a specific symbol), an action of the driver interacting with the latter is "captured". In step 331, the capture method (i.e. receives indication of) an action on the revision template: this action is linked or linked to or associated with the alphanumeric value entry. In other words and in a particular way, step 331 captures the position of the finger relative to the model on which it interacts and deduces the associated alphanumeric variable (s).
[0021] Subsequently, this value is displayed, possibly optimally. The display of the value can for example be carried out at different places in the pilot's visual field, for example near the means of revision (finger, cursor) or at other places in the cockpit (head-up projection, overprinting). augmented reality type, 3D rendering etc.).
[0022] The methods of restoring the captured values (in return for their selection) can be carried out in several ways. In particular, in a specific embodiment, the display is performed with roundings depending on the speed of the finger (on the touch interface) and / or the aeronautical unit of the parameter being modified. Indeed, the method may in particular use rounding of the manipulated variable to determine the value that will be used in the following steps. These roundings can be statically defined according to the type of data, or via a rounding database, for each variable handled. Advantageously, the speed of movement of the finger (or cursor) on the touch interface can be used to define the roundings to be applied. Advantageously, the position of the finger on the model, between two terminals, can be used to define the roundings to be applied. Advantageously, the position of the finger relative to the center of the model can be used to define the roundings. The result (i.e. the numerical value) is sent to the next step. In step 332, from the previously captured action an alphanumeric parameter is determined. In one embodiment, a value is determined or calculated and then displayed (possibly in real time or near real time). Intermediate data processing can be performed, including unit conversions. For example, the unit of an alphanumeric value received from step 331 (for example in aeronautical units) can be transformed to correspond to the units used by the digital core of the onboard system ((for example in SI units for the FMS) The method 30 can also perform bounding of the linked values (for example the minimum and maximum altitudes for a window or "Windows", the action on one of which can indirectly influence the other) or a boundary value limit (For example with regard to the altitude cap) Advantageously, a rules database can be provided for the values (bounding ...) Advantageously, an optional variant of the invention can implement a "autorange" when the pointing device is brought to the limit of the screen: if during the definition of a distance, the movement of the finger is limited by the edge of the screen, then the "range" can be modified automatically, for example with a repositioning of the cursor or a concomitant change of the "range" and "slew" of the point as revised by finger on the touch interface. Alternatively, the "range" may remain unchanged but the numerical value will be displayed in the alphanumeric box (the "range" will only be changed for displaying the result). In one embodiment, the CDS screen itself is "interactive." For example, the choice of the interaction modes and the "range" is done by touching the arcs of the rose or the circles of the plane mode. (This configuration advantageously avoiding the current rotators.) In step 340, the method represents the result of the revision - in real time or near real time - for example according to the alphanumeric values as determined in step 332.
[0023] In an advantageous but optional embodiment, in step 351, the validity of the model can be tested. The method can for example determine the "volability" of the result, and present it with an associated symbology (ex: "overlap" or overlapping trajectories, nonvolatile offset, unstable altitude constraint ...). If necessary, at step 352, the method modifies the revision model depending, for example, on (a) the required accuracy (for example, at the end of the revision it may be integrated a "rough" model (or " (in English) in order to initialize the revision, or a "fine" or "fine" model in order to adjust it, (b) other modified parameters. time parameter can be either an absolute time (UTC, materialized by a clock or an HHMMSS representation), a relative time (chronometer representation), or a delay relative to the current time (hourglass representation). the revision is confirmed (respectively canceled), the FMS system is updated, the model is deleted, and the process returns to the stage of detection or determination of the objects (or display areas) manipulated on the screen .
[0024] In step 353 and 354, the method according to the invention can retrieve validation or erasure information from the revision (for example following a click on "OK" or "KO"). If a click on KO is chosen, the method repeats the steps of capturing the actions. If a click on OK is chosen, the process validates the revision at the digital core, the 3027127 22 SMS and clears the symbologies which were used for the revision, as well as the menus of validation / erasure, then the process waits a new revision . Advantageous but optional embodiments are described below. Optionally, finger-modified values on the touch interface change color depending on the results of FMS calculations. For example, a white value may indicate that the resulting calculation is nominal (ie no risk to the aircraft), that an orange or amber value indicates that the calculation produces a result that is close to the acceptable limit values, and that red value indicates an unacceptable result (which will be rejected or automatically readjusted to the nearest acceptable value.) Figure 4 shows an example of ranking 400 revisions and different business parameter examples (421 to 429). The revisions are divided into three basic types or families or categories or main classes: 1) the family of revisions that do not require alphanumeric entry (eg moving a point); 2) the family of alphanumeric single-entry revisions (only one parameter is concerned, for example the entry of an ATO for "Along track offset" which makes it possible to define a point in relative distance with respect to another, the parameter is therefore the distance, signed (+/-)) and 3) the family of multi-alphanumeric revisions (several parameters are involved, for example the entry of a racetrack waiting) For each category of revisions, the process is based or refers to a library of predefined "business models." These models are also called "unitary models." Thus, in aeronautics in general, and for mission management systems (FMS, EFB, TAXI ...), the different models are of type a) Distance and length b) Circular spacing c) Linear distance d) Arrival on an element e) Angle output on an element f) Altitude g) Speed h) Time i) Lat / Long j) Mass k) Centering I) type "integers" m) type "discrete enumerated in a list of choices" The current revisions of standardized FMS (including AEEC ARINC 702), currently in flight on most airliners and business planes include revisions: 1) creating or modifying type FMS elements point or leg; 2) defining the constraints associated with an element (point / Leg); 3) defining constraints on a part of the trajectory (defining waiting or alignment / reversing procedures, defining tactical procedures, of type shortening trajectory, type, defining the weather environment, defining the airplane state, defining the positioning of the aircraft, administration of the various flight plans of the aircraft). Other revisions are possible and can be manipulated by the method according to the invention. Figure 4 shows nine parameters, typical of the FMS business: character string 421, altitude 422, speed 423, time 424, distance / length 425, angle 426, state / type 427, coordinates 428, number 429. This parameter list is provided by way of illustration and can not be limiting: the method according to the invention can be applied to any list of predefined parameters (eg a parameter can be split into several sub-parameters, which can be grouped together and differently, etc.). Advantageously, it is possible to determine a domain of use of a parameter (or of several parameters) of the unitary or elementary model, so that it is possible to select / modify the parameter only according to authorized values, for example a) by applying a graphical mask (for example between the minimum and maximum values of the parameter) on the model, the associated advantage residing notably in the genericity of the displayed model which can always be the complete unitary model) or b) by graphically restricting the model itself. same (for example to the minimum and maximum values, the associated advantage then residing in a rapid readability of the terminals) Figures 5 to 11 show different examples of symbologies according to the invention. The different symbols represented in FIGS. 5 to 11 may be used or implemented by touch interface ("finger") or by the manipulation of pointing devices (eg mouse cursor, trackball, rotators, ToF Time camera device). of Flight, depth sensor, motion sensor, eye tracking, head tracking or head tracking, EEG commands "brain wave", gesture control eg with accelerometers and / or or gyrometers, haptic sensors, etc.). In other words, a symbology according to the invention can be realized in a "cursor" version and / or in a "tactile" version, that is to say exclusively at the cursor or exclusively by touch interface or else by a combination of both types of interface. Figure 5 illustrates a symbology for entering a distance. The initialization of the interaction consists in positioning on the element or the object being revised a graphic symbol (represented by a triangle 500 in the example of FIG. 5). A second graphic symbol corresponding to a "modification point" makes it possible to carry out said revision. The second graphic symbol is represented by a triangle 510 in the example of FIG.
[0025] The numerical value of the distance is displayed, for example in a "distance box" 530, for example under the "change point" 510. An initial value equal to zero was chosen by default in the example, but it is understood that a different default value may be used, for example depending on the context of the revision. Step (A) corresponds to the initial situation. In the cursor version, the cursor can be automatically positioned on the "starting point". In the "finger" version, according to one embodiment, the finger is placed on the "starting point" to begin the interaction. In step (B), the second graphic symbol 510 or "modification point" 510 is moved, either by moving the cursor or by moving the finger on the touch interface. According to one embodiment, the "distance box" 530 also moves, in order to remain in the field of view. According to an alternative embodiment, the "remote box" 530 remains at a fixed position. In one embodiment, the alphanumeric value (i.e. the distance) is displayed in real time in the "remote box" 530. The validation can be done in different ways. In a nonlimiting way, the validation can be done: by drag and drop, by clicking with the cursor if necessary, by raising the finger of the tactile interface, by pressing (eg double "tap" etc. subsequently, either the revision is immediately taken into account, or a "confirmation box" 540 appears. ("OK" to confirm the revision or "KO" to cancel it). In the case where the revision is immediately applied, the pilot may be given the opportunity to cancel the last actions by presenting an "UNDO" button (each click on this button replacing the system in its previous state. Cursor version, the cursor can optionally be set to "OK" by default Alternatively, the cursor can be left in. Confirmation by click / selection on "OK" ends the revision. The dialog boxes disappear. particular embodiments, if at the confirming step the finger or the pointing device is again placed on the "modification point", the latter can return to the state of the second graphic symbol in order to allow to continue The "validation box" then disappears, this distance symbology as described can be used on a plane display (for example at ND in Lat / Long) or a vertical display (for example). xample to the VD for "Vertical display" in altitude / distance). In addition, a change of unit can be done by simple click or finger selection on the unit in question, in the "altitude box". For example, it is possible to go from unity to NM (Nautical Miles for Nautical Miles) to FT (Feet) then to KM (kilometers). Figure 6 illustrates an example of options for value entry. Optionally, in order to refine the values entered, an embodiment of the method according to the invention comprises one or more additional steps. After raising the finger, it is proposed to refine the value with "+" buttons 601 and "2 602 located on either side of the displayed value (with or without overlap, with or without display overlay) These "+" buttons 601 and "-" 602 can for example be implemented by dividing the display area 10 of the revised figure into two parts: a click on the left zone decrements the revised value while a click on the zone The graphical option avoids having to define new graphic elements Figure 7 illustrates an example of symbology for the processing of values that are in a defined range (minimum value 710 is maximum value 720). The range of values is represented as a horizontal or vertical bar 700. The interaction principle is similar to that of FIG. 5. In one embodiment, the revisions may be implicit, for example depending on the displacement or sliding of fingers. t between two elements, from the starting point to the designation point. In the first case, the starting point is a point on the flight plan. An element of the flight plan is selected by the pilot, then this element is "dragged" or moved to another element of the flight plan or the MAP (a waypoint, a tag, ...). A "shorten" FPLN revision between these two points can be automatically performed, directly connecting the two points of the flight plan and erasing the intermediate elements. Similarly, the discontinuity between the starting point and the designation point can be automatically cleared (Clear_Disco). A new flight point can be inserted (for example if the designation point is the point of the MAP.) In an alternative, a contextual revision menu can be opened between the two elements in order to extend the possibilities (for example non-limiting way: Shorten, Insert Next Waypoint, calculation of the Distance / Cap pair between the elements, calculation of the duration / fuel to fly to the point and possibly the fuel to the destination if we go through this point ("what if" In an alternative, the raised finger without having designated an element, the revision Insert_Nxt_Wpt is then realized by creating an OMD positioned at the place where the pilot has raised the finger .In an alternative, a movement is made. of the "waypoint" from the starting point, in an alternative, it may be proposed to make a DIR TO RADIAL OUT by displaying the radial formed by the starting point and the designation point. green a contextual menu proposing the insertion revisions of the next "waypoint" (and also other parameters such as "move waypoint" and offset, DIR TO RADIAL OUT etc.) In a second case, the starting point is an element of the MAP. an element of the MAP (waypoint, navaid, ... or a position) is then selected, then it is dragged to the cursor cursor said element to an element of the flight plan, then the finger is raised. Distance and heading are displayed as you go. when lifting the finger of the touch interface the flight plan is changed automatically. The starting point is inserted before the designation point. A discontinuity (if any) is inserted before the starting point in the resulting flight plan. If the starting point does not represent a known element of the MAP (just one position), a point is created in MDG. In an alternative, a contextual menu is opened between the two elements in order to extend the possibilities (for example if the starting point is a beacon, it is proposed to "tune" the beacon when it reaches this point. designation is replaced by the starting point, alternatively, the starting point is moved and then a point in the flight plan is designated, it is then proposed to make a command or revision "DIR TO RADIAL IN" by displaying the radial In one embodiment, the screen is "multi-touch", that is, adapted to receiving multiple and simultaneous commands. For example, the use of multiple fingers may correspond to a fast scrolling of values, whereas an interaction with a single finger may correspond to a reduced scrolling speed (but Conversely allow for more precise adjustments) In general, the use of graphical effects can help to enrich the interaction and particularly to materialize temporary revised appearance. For example, the link between a revised element and the finger or cursor can be represented as a dotted line. Graphic effects (eg flashing, animations, color codes, artifacts, etc.) can enrich the interaction. Figure 8 illustrates a symbology for the Circular Spacer model. In the example illustrated in FIG. 8t, only part of the arc 800 is represented. According to the context of the revision, all or part of the arc 800 can be represented (when the arc is fully represented, it means that the entire circle is displayed around the starting element). The initialization of the interaction consists in positioning, on the revised element (a graphic symbol in the form of a triangle in the example), a "modification arc" of the revision (the circle). The numerical value of the distance is also displayed in a box 810, for example under the "modification arc". The value 1 NM is indicated by default, but a different default value can be used depending on the revision context. In the "cursor" version, the cursor can be automatically positioned on the "modification arc" 800, above the revised point for example. In the "finger" version, the finger can be positioned on the "change arc" 800 to begin the interaction. in the next step, the cursor is moved either by moving the cursor or by moving the finger. The "modification arc" 800 "expands" with the cursor / finger, as well as the "remote box" 810 to remain in the field of view. The alphanumeric value (i.e. the distance) is displayed in real time in the "remote box" 810. The subsequent steps (e.g. validation) proceed in a manner similar to the corresponding steps of the previously described symbols. A symbology for the model "Linear distance" (not shown in the figures) can be the same as that used for the circular spacing, except that the "distance box" can display the distance along the path by compared to the revised element. An algorithm then calculates the intersection between the arc of the circle and the trajectory, as close as possible to the revised point, and determines the path length between the revised point and the intersection in question. The advantage associated with this embodiment lies in the fact that, for some revisions, the displacement of a cursor can follow the trajectory if the revision is called ATO. In this case, moving the finger in the same context on the screen will cause a displacement of the path under the finger (registration) or the display of an arc if the finger is no longer on the path considered. The numerical value can be the distance between the finger and the starting point, or the distance along the trajectory. in other words, the airplane symbol is selected and then slides to the rear of the A / C (optionally optional) and then to one side of the screen, creating an offset and a display of the trajectory offset in real time or near real time. Figure 9 illustrates an example of symbology related to the definition of angles (cursor and / or finger). Similarly, the initialization of the interaction consists in positioning, on the revised element (a triangle 900 in the example), a "modifying half-line" of the revision, associated with a "pink" 920 (the north-facing circle for example) .The numerical value of the angle is also displayed in an "angle box" 930, under the "modification half-line" 910. the numerical value equal to zero is As a default example, a different default value can be used depending on the context of the revision.In the "cursor" version, the cursor can be automatically positioned on the "modification half-line". For example, in the "finger" version, the finger can be positioned on the "modifying half-line" to begin the interaction, and in the next step, the cursor is moved, either by moving the cursor, either by moving the finger. emi-right edit "moves with the cursor / finger, as well as the" box angle "in order to stay in the field of view. The alphanumeric value (the angle relative to the reference, here the North) is displayed in real time in the "box angle". The subsequent steps (e.g. validation) proceed in a manner similar to the corresponding steps of the previously described symbols. This symbology can in particular be used for angular modifications "towards an element" or for angular modifications "from an element". In order for the method to be able to determine whether it is an action "to" or "from" an element, the method can initially set the arrow to a default value (for example "to the element" ). To change direction, a click on the arrow can move to the value "from the element". In one embodiment, if the blue revision circle is returned to and through the revision point, the direction of the arrow may be reversed. In an alternative embodiment, to visually discriminate the two directions, it can be added in the "box angle" character "IN" or "OUT" or an arrow on the line of movement (not shown in the figures). This symbology can be used on a plane display (eg ND in Lat / Long) or vertical (ex CD in altitude / distance). In the case of the VD display, the symbology can represent the slope (Delta Altitude with respect to the Distance delta). Advantageously, the speed of movement of the cursor or the finger can be used by the system to associate a more or less fine granularity level of the manipulated variable. Thus a rapid displacement can be associated with rounded and integer angle increments of 2 ° in 2 ° or 5 ° in 5 °. A slower displacement can be associated with rounding and integer increments of 1 °, see rounding to 1/2. On a VD type screen where the angles are finer, for example for aerodynamic slopes of descent, between 1 and 4 °, displacements will be interpreted in tenths of degrees. According to an optional embodiment, the entered numerical values can be refined by means of the "-F" and "2" buttons as explained above, while FIG. 10 illustrates an example of symbology for the attitude model (eg altitude definition, cursor or finger) The initialization of the interaction consists in positioning, on - or beside - the element 1001 revised (corresponding to a triangle 1000 representing the airplane), a "scale of modification" of the revision 1010. The numerical value of the altitude and its unit is displayed in an "altitude box" 1020, for example under the "scale of modification". A graphic symbol (in this case the circle 1001) is materialized on the scale, in the middle. Its displacement corresponds to the evolution of the altitude, in one direction or the other (as it is moved above or below its midpoint.) In a subsequent step, the cursor is moved either moving the cursor by means of a pointing device, or by moving the finger on the touch interface. The graphic symbol 1001 moves following the selection on the "modification scale". The alphanumeric altitude value is calculated and displayed in real time in the "altitude box" 1020. A default initialization value can be set to 5000 feet but different default values can be used, for example depending on the context. of the revision. In a "cursor" embodiment, the cursor can be automatically positioned on the "scale of modification", for example in the middle. In a "finger" embodiment, the finger can be positioned on the "scale of modification" to begin the interaction. The symbology associated with the attitude model has the advantage of taking up little space on the display screen, compared to a complete scale of altitude (to represent a scale of 40000 ft, with a selection to 100ft near would be difficult on a simple scale of altitude). The subsequent steps (e.g. validation) proceed in a manner similar to the corresponding steps of the previously described symbols. Moreover, changes of units (e.g. feet, meters, flight level, etc.) can also be done directly by simply clicking on the finger (for example in the "altitude box"). Altitude values can be bounded, for example by a ceiling value 1031 or a floor value 1032. These values can be determined by the system (e.g. may depend on the revision). When a value abuts, the "altitude box" may freeze the value at the terminal and a symbology change may be made to indicate the reason for the boundary. The move button (circle) can also change to indicate reaching a terminal. In an alternative embodiment (not shown in the figures), the reaching of a terminal (maximum ceiling ceiling said "ceiling" in English) can be materialized by a specific display of the altitude box 1020 (eg color red, flashing etc.). In an alternative embodiment, the values of the terminals can advantageously be displayed on the ornes of the scale. Figure 11 illustrates an example of symbology related to the display of speeds (cursor or finger). In an alternative display embodiment is of the analog meter type: the action is performed directly on the counter hand, with a digital display control. Various other unrepresented symbologies are possible, in particular the symbologies retained for a) the time type model (action on the hands of a clock, chronometer, hourglass, etc.), b) the model of lat / long type (eg display of a cross and transparency display of a latitude and longitude grid to better locate the aircraft), c) the mass-type model (eg involving the unladen mass, the mass freight, the passenger mass, the fuel mass, different options are possible in this case, synthetic or total symbology or several separate symbologies can be used); d) the centering model (e.g. aircraft viewed in profile with one or more graphic symbols for changing the centering of the aircraft, as well as options adapted for more precise adjustments); e) the model of type "integers" and f) the model of the type "enumerated discrete in a list with choices" (eg symbology in correspondence with the modeled values, for example for the position beaks and shutters, the representation will be able to use a symbol in the form of a wing profile). In general, the list of models can be stored in a database, for example predefined, configured from the ground or on board. In order to leave a revision in progress, whatever the nature of this revision, the method according to the invention can use several techniques. A click (or touch selection) on another element cancels the current revision and opens a dialog box on the new selected element to choose a revision. A click or selection on the screen, in an area outside the area corresponding to the revised item, may cancel the current review. The zone corresponding to the revised element may correspond to the graphical display area 30 of modification graphic elements (half-line, scale, pink, etc.) with a configurable margin (for example). in an alternative embodiment, when a revision is selected, a button of the type "CANCEL" or "DELETE" or "KO" or "RETURN" can be permanently displayed, instead of the buttons "KO" and "OK" "until the" KO "and" OK "buttons appear (ie when the change is complete). Figure 12 illustrates the superposition of different symbologies on a display screen 1200 of the FMS. In a situation provided by way of example, the crew wishes to enter a race track 1210, for example on a refueling rendezvous in flight, or on instruction of control sufficiently free to be carried out by the pilot as he hears. The pilot then seeks to optimize the maneuver. In practice, many alphanumeric entries are necessary in order to determine the geometry of a racetrack. A racetrack is characterized by 4 parameters: 1) the axis (in degrees), 2) the direction (left or right), either "L" or "R" in English, 3) the length of the right segment (called "inbound") leg "in aeronautical terminology, typically NM (Nautical Miles), or time (in min or sec), 4) racetrack gauge (in NM, or turn angle in degrees) Some parameters may be dependent in some FMS (eg the gap corresponds to the% turn, and depends on the roll, which can be a function of the speed and altitude in some implementations). Figure 12 shows such a racetrack, entered by the pilot in the screen cartridge with its different characteristics: the arrival angle 1211 on the hook point of the racecourse (LACOU) is 180 °, the The length of straight branches 1212 (called inbound and outbound) is 6 NM and the 1213 (Width) is 2 NM. For the capture of this race track waiting, several symbologies can be superimposed: a) a symbology of the model "distance length" on the straight line of arrival on the point of attachment of the racecourse, allowing to modify manually the length ; optionally, a symbology of the duration (hourglass) type on the on the arrival straight line on the hitch-point of the racetrack, making it possible to manually modify the travel time; b) a symbology of the "angle" model on the racetrack hook point; optionally, c) a symbology of type linear distance between the 2 straight lines of the racetrack; optionally, d) a numerical "counter" type symbology for selecting the number of laps of the racetrack; e) optionally, a "clock" type symbology for entering an exit time; f) Optionally, a symbology of "fuel" type to adjust the desired fuel output (affects the number of revolutions). According to other examples, it is possible to superimpose an angular symbology, a linear distance symbology (length of the right segment) and a distance symbology for the distance of the racecourse, etc. FIG. 12 thus illustrates examples of input tasks that are typical in the context of piloting an aircraft. The method of the invention greatly simplifies the load of the pilot. In a few glances, the pilot can visualize all the options available to him, the impacts of these different options, unambiguously and with relative security as to the input of information. FIG. 13 illustrates various aspects relating to HMI man-machine interfaces that can be implemented to implement the method according to the invention. In addition to - or as a substitute for - the FMS and / or EFB on-board computer screens, additional HMI means can be used. In general, avionic systems FMS (which are systems certified by the air regulator and which may have certain limitations in terms of display and / or ergonomics) may advantageously be complemented by non-avionic means, in particular aircraft. Advanced HMIs. Among these advanced HMIs, certain embodiments of the invention may be implemented by augmented reality means AR (e.g., projectors, spectacles, etc.) and / or virtual reality VR (e.g., visor, visiocasque, etc.). Some embodiments may be hybrid or hybrid ARNR or in other words combine EVS means, acronym for "Enhanced Vision System" and / or means SVS, acronym for "Synthetic Vision System". For example, projection means may project information on the windshield and / or interior elements of the cockpit 15 of the aircraft. In particular, said man-machine interfaces can make use of virtual and / or augmented reality headsets. Figure 13 shows a 1310 opaque virtual reality helmet (or semi-transparent augmented reality headset or configurable transparency helmet) worn by the pilot. The 1310 individual display headset may be a virtual reality headset (RV or VR), or augmented reality headset (RA or AR) or a high aim, etc. The headset may thus be a head-mounted display, a wearable computer, glasses or a headset.The headset may comprise means of calculation and communication 1311, projection means 1312, means 3027127 33 audio acquisition 1313 and video projection and / or video acquisition means 1314 (for example, use for "scraping" data accessible analogically from the cockpit or flight deck of the aircraft). , the pilot can - for example by means of voice commands - configure the visualization of the flight plan in three dimensions (3D) .The information displayed in the helmet 1310 can be entirely virtual (displayed in the individual helmet), entirely real ( for example projected on the flat surfaces available in the real environment of the cockpit) or a combination of both (partly a virtual display superimposed or merged with reality and partly a real display via projectors). The display may also be characterized by the application of predefined placement rules and display rules. For example, man-machine interfaces (or information) may be "distributed" (segmented into discrete, possibly partially redundant, then distributed portions) between different virtual (e.g., 610) or real (e.g., FMS, TAXI) screens.
[0026] The various steps of the method may be implemented wholly or partly on the FMS and / or on one or more EFBs. In a particular embodiment, all the information is displayed on the screens of the single FMS. In another embodiment, the information associated with the steps of the method are displayed on the only embedded EFBs. Finally, in another embodiment, the screens of the FMS and an EFB can be used together, for example by "distributing" the information on the different screens of the different devices. Proper spatial distribution of information can help to reduce the driver's cognitive load and thereby improve decision-making and increase flight safety. With regard to the system aspects, certain embodiments are advantageous (for example in terms of ergonomics and concrete implementation possibilities in the cockpits of existing aircraft). The different steps of the method according to the invention can in particular be implemented in the human machine interface HMI of the FMS (which interacts on the one hand with the heart of the FMS - FPLN, TRAJ, PRED - and on the other hand with the screen CDS display). The models can be stored in the CDS or the FMS and / or configurable via a database. The various steps of the method according to the invention can also be carried out within equipment such as EFB, ANF, ground stations TP or tablet.
[0027] The present invention may be implemented from hardware and / or software elements. It may be available as a computer program product on a computer readable medium. The support can be electronic, magnetic, optical or electromagnetic. The means or computer resources can be distributed (cloud computing 5 or "Cloud computing"). Various other aspects of the invention are described below. In one embodiment, for example depending on certain actions of the pilot, the method determines a target element on the screen. The method then determines elementary interaction patterns of "substitution". By the term "substitution" is meant taking into account the context of interaction. For example, a substitution interaction model can be determined (and then used) based on a selected revision. If the predetermined revision action comprises alphanumeric entry, the method according to the invention can generate a display comprising a graphical input action, said display corresponding to said and being determined from a predefined list of alphanumeric / graphical substitution patterns. the basic commands in distance, altitude, speed, time, mass and centering, discrete. In one embodiment, when an action is determined on a flight plan element or a portion of the trajectory - or any other element displayed on the screen -, the method can determine a "graphic mask" to be applied to the selected element, from a set of predetermined masks, and corresponding to the data to be manipulated. The management of layers or levels of graphic abstraction is advantageous in that it allows a great flexibility of use. In a subsequent step, the method according to the invention can in a way transform the action of the pilot on the mask into alphanumeric data, to deduce from it the revision to be applied in the heart of the FMS, on the flight plan, the trajectory , predictions, guidance, and other functions of the FMS. In one embodiment, as the finger is applied repetitively - or for a long time on the touch screen (for a faster incrementation or decrementation for example) or an equivalent pointing device functionally on a non-screen. tactile -, the data 30 captured and interpreted are communicated to the digital "heart" of the FMS, for calculating and displaying the effect of the action captured on the elements of the FPLN (flight plan, trajectory ...). 35

权利要求:
Claims (15)
[0001]
REVENDICATIONS1. A computer graphic interaction method for controlling an aircraft comprising the steps of: - receiving indication of a selected object on a display screen of the aircraft; - determine one or more flight plan revisions of the aircraft associated with the selected object and display one or more of said flight plan revisions; - receive indication of a selection of a displayed revision; - determine a type of revision associated with the revision displayed and selected; depending on the type of revision determined, display a graphical symbol for entering data by touch interface; said graphical data entry symbol being selected in a symbology comprising a plurality of graphical data entry symbols.
[0002]
The method of claim 1, the method further comprising a step of receiving one or more data as a result of manipulating the graphical data entry symbol.
[0003]
The method of claim 2, the method further comprising a step of modifying one or more of the received data. 20
[0004]
The method of claim 2 or 3, the method further comprising a step of validating the selected revision.
[0005]
The method of claim 2 or 3, the method further comprising a step of modifying the selected revision.
[0006]
The method of any of the preceding claims, the method further comprising a step of changing the display of the graphical data entry symbol based on parameters including a measure of the driver's cognitive load and / or the flight context of the aircraft.
[0007]
The method of any of the preceding claims, the step of displaying the graphical data entry symbol comprising a step of spatially and / or temporally distributing said display. 35 36 3027127
[0008]
The method according to any one of the preceding claims, the method further comprising a step of receiving or determining a parameter associated with the indication of the selected object on the display screen of the aircraft
[0009]
9. The method of claim 8, the step of determining one or more revisions of the flight plan of the aircraft associated with the selected object being a function of said parameter associated with the indication of the selected object.
[0010]
10. The method of claim 8 or 9, the step of determining and / or displaying a graphical symbol for data input by touch interface being a function of said parameter associated with the indication of the selected object.
[0011]
11. A method according to any one of the preceding claims, the step of determining and / or displaying a graphical symbol for data input by touch interface being a function of one or more parameters comprising a) the number of data to be entered b) the type of revision to be performed, c) the type of unit of the entry d) the display range e) the type of representation and / or f) one or more predefined criteria.
[0012]
12. System comprising means for implementing the steps of the method according to any one of claims 1 to 11.
[0013]
System according to claim 12, comprising a PFD main flight screen and / or an NDND navigation screen and / or a multifunction MFD screen.
[0014]
14. System according to claim 12 or 13, comprising avionics of the Flight Management System type and / or non-avionic means of Electronic Flight Bag type and / or augmented and / or virtual reality means.
[0015]
15. System according to any one of claims 12 to 14, comprising interface means exclusively of touch type. 25

类似技术:

---

公开号 | 公开日 | 专利标题

---

FR3027127A1|2016-04-15|TOUCH INTERFACE FOR THE FLIGHT MANAGEMENT SYSTEM OF AN AIRCRAFT

---

FR3046225B1|2019-06-28|DISPLAY OF WEATHER DATA IN AN AIRCRAFT

---

US9805606B2|2017-10-31|Man-machine interface for the management of the trajectory of an aircraft

---

FR3039643A1|2017-02-03|HUMAN-MACHINE INTERFACE FOR THE FLIGHT MANAGEMENT OF AN AIRCRAFT

---

EP3187826B1|2019-10-23|Display of meteorological data in an aircraft

---

EP0877915B1|2002-04-24|Air navigation assistance device and method

---

FR3021401A1|2015-11-27|RECONFIGURATION OF THE DISPLAY OF A FLIGHT PLAN FOR THE PILOTAGE OF AN AIRCRAFT

---

FR3020882A1|2015-11-13|OPTIMIZING THE TRACK OF AN AIRCRAFT

---

EP1347412A1|2003-09-24|Apparatus for visualizing an airport

---

EP2600107A1|2013-06-05|Device for interactive dialogue between an aircraft operator and a system for guiding said aircraft

---

US9530322B2|2016-12-27|Contextual aid to flight management

---

WO2012080453A1|2012-06-21|Method for the temporal display of the mission of an aircraft

---

WO2017178640A1|2017-10-19|Method of displaying data for aircraft flight management, and associated computer program product and system

---

FR3025920A1|2016-03-18|METHOD FOR REAL-TIME CALCULATION OF A PLANNED TRACK, IN PARTICULAR A FLIGHT PLAN, COMBINING A MISSION, AND A SYSTEM FOR MANAGING SUCH A TRAJECTORY

---

FR2991094A1|2013-11-29|DEVICE FOR FLIGHT MANAGEMENT OF AN AIRCRAFT ADAPTED TO CONTROL OF MULTI-TIME CONSTRAINTS AND CORRESPONDING METHOD

---

FR3048773A1|2017-09-15|METHOD AND SYSTEM FOR MANAGING A MULTI-DESTINATION FLIGHT PLAN

---

FR3038750A1|2017-01-13|METHOD FOR INTEGRATING A NEW NAVIGATION SERVICE IN AN OPEN AIR ARCHITECTURE OPEN ARCHITECTURE SYSTEM OF A CLIENT-SERVER TYPE, IN PARTICULAR A FIM MANUFACTURING SERVICE

---

FR3058555A1|2018-05-11|UNIFORMIZATION OF PLATFORM APPROACHES FOR AIRCRAFT

---

FR3065545A1|2018-10-26|METHOD FOR DETECTING A USER SIGNAL FOR GENERATING AT LEAST ONE INSTRUCTION FOR CONTROLLING AN AIRCRAFT AVIONAL EQUIPMENT, COMPUTER PROGRAM AND ELECTRONIC DEVICE THEREFOR

---

FR3043487A1|2017-05-12|AIRCRAFT TRAJECTORY MANAGEMENT IN THE EVENT OF AN ENGINE FAILURE

---

FR3038751A1|2017-01-13|METHOD FOR INTEGRATING A CONSTRAINED ROAD OPTIMIZATION APPLICATION IN AN OPEN ARCHITECTURE AIRCRAFT SYSTEM OF CLIENT-TYPE SERVER

---

EP3112814A1|2017-01-04|Viewing system comprising means for selecting, sharing and displaying graphical objects in different viewing modes and method therefore

---

CN107284679A|2017-10-24|System and method for providing from the automatic flight performance feedback of aircraft to pilot

---

US10399698B2|2019-09-03|Systems and methods for smart vision runway landing display

---

EP3764341A1|2021-01-13|Method and electronic system for flight management of an aircraft in visual approach phase of a runway, associated computer program

同族专利:

---

公开号 | 公开日

---

US20160103579A1|2016-04-14|

---

CN105509746B|2020-10-30|

---

US10055116B2|2018-08-21|

---

CN105509746A|2016-04-20|

---

FR3027127B1|2017-12-08|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

US7162335B2|2003-12-19|2007-01-09|Honeywell International, Inc.|Graphic airways displays for flight management systems|

---

US8380366B1|2008-03-12|2013-02-19|Garmin International, Inc.|Apparatus for touch screen avionic device|

---

EP2679959A2|2012-06-25|2014-01-01|Honeywell International Inc.|Avionics display system providing enhanced flight-plan management|

---

JP3052286B2|1997-08-28|2000-06-12|防衛庁技術研究本部長|Flight system and pseudo visual field forming device for aircraft|

---

US6112141A|1997-10-15|2000-08-29|Dassault Aviation|Apparatus and method for graphically oriented aircraft display and control|

---

US6484072B1|2001-09-28|2002-11-19|The United States Of America As Represented By The Secretary Of The Navy|Embedded terrain awareness warning system for aircraft|

---

US7256818B2|2002-05-20|2007-08-14|Simmonds Precision Products, Inc.|Detecting fire using cameras|

---

US7505604B2|2002-05-20|2009-03-17|Simmonds Precision Prodcuts, Inc.|Method for detection and recognition of fog presence within an aircraft compartment using video images|

---

US7280696B2|2002-05-20|2007-10-09|Simmonds Precision Products, Inc.|Video detection/verification system|

---

AU2003255699B2|2002-06-18|2009-01-22|Amadeus S.A.S.|Method for loading flight schedule modifications|

---

IL153291A|2002-12-05|2010-05-31|Nir Padan|System and method for situation assessment and dynamic guidance to aerial vehicles for the optimal conduct of close-in maneuvering air combat|

---

US20040162648A1|2003-02-18|2004-08-19|Honeywell International, Inc.|Configurable cockpit information presentation device|

---

FR2853064B1|2003-03-28|2005-06-24|ON-BOARD FLIGHT MANAGEMENT SYSTEM FOR AIRCRAFT|

---

CA2521179C|2003-03-31|2014-02-11|Sikorsky Aircraft Corporation|Technical design concepts to improve helicopter obstacle avoidance and operations in "brownout" conditions|

---

US7383106B1|2005-05-31|2008-06-03|Coonse Jr Lester C|Active noise control system for aircraft, and method for enhancing pilot situational awareness|

---

US7881832B2|2006-06-09|2011-02-01|Garmin International, Inc.|Automatic speech recognition system and method for aircraft|

---

US20080262664A1|2006-07-25|2008-10-23|Thomas Schnell|Synthetic vision system and methods|

---

FR2910678B1|2006-12-21|2009-03-06|Thales Sa|MODIFIABLE FLIGHT PLAN STRUCTURE NOT AFFECTING ITS OPERATIONAL CONSTRAINTS|

---

FR2923044B1|2007-10-31|2012-11-09|Airbus France|DEVICE FOR MANAGING A REST FOR THE DRIVERS OF AN AIRCRAFT.|

---

US7903000B2|2008-04-29|2011-03-08|The Boeing Company|Representing a holding pattern on a vertical situation display|

---

US20090319100A1|2008-06-20|2009-12-24|Honeywell International Inc.|Systems and methods for defining and rendering a trajectory|

---

EP2362951B1|2008-06-27|2013-09-04|Raytheon Company|Apparatus and method of controlling an unmanned vehicle|

---

FR2935179B1|2008-08-20|2010-12-03|Airbus France|METHOD AND DEVICE FOR ASSISTANCE IN CONTROLLING ON-AIR SYSTEMS IN AN AIRCRAFT|

---

FR2935187B1|2008-08-20|2010-09-17|Airbus France|METHOD AND DEVICE FOR SHARING DATA BETWEEN ONBOARD SYSTEMS IN AN AIRCRAFT|

---

KR20100030404A|2008-09-10|2010-03-18|김현규|User information input method by recognizing a context-aware on screens|

---

CN101881969B|2009-09-03|2012-03-14|中国航空无线电电子研究所|Flight management system and method thereof based on multi-task parallel processing|

---

FR2954561B1|2009-12-23|2012-08-03|Airbus Operations Sas|METHOD AND DEVICE FOR DETECTING THE ABSENCE OF REACTION FROM THE CREW OF AN AIRCRAFT TO AN ALARM RELATED TO A TRACK.|

---

US8600587B1|2010-09-16|2013-12-03|Rockwell Collins, Inc.|System and method for determining an object threat level|

---

US8694184B1|2010-09-21|2014-04-08|The Boeing Company|Methods, systems, and apparatus for layered and multi-indexed flight management interface|

---

US20120075122A1|2010-09-24|2012-03-29|Honeywell International Inc.|Alert generation and related aircraft operating methods|

---

US9703476B1|2010-12-23|2017-07-11|The Boeing Company|Multi-touch cockpit interface for controlling aircraft systems|

---

US9032319B1|2011-03-24|2015-05-12|The Boeing Company|Methods, systems, and apparatus for handling of flight deck data|

---

US9293054B2|2011-11-11|2016-03-22|Aptima, Inc.|Systems and methods to react to environmental input|

---

US20130132522A1|2011-11-23|2013-05-23|Arthur Oded Ruppin|Transportation vehicle's remote data storage system|

---

US9423871B2|2012-08-07|2016-08-23|Honeywell International Inc.|System and method for reducing the effects of inadvertent touch on a touch screen controller|

---

US8825234B2|2012-10-15|2014-09-02|The Boeing Company|Turbulence mitigation for touch screen systems|

---

US20140300555A1|2013-04-05|2014-10-09|Honeywell International Inc.|Avionic touchscreen control systems and program products having "no look" control selection feature|

---

US9714081B1|2013-08-29|2017-07-25|Rockwell Collins, Inc.|System and method for avionics integrity and protection|

---

US9718558B2|2014-02-26|2017-08-01|Honeywell International Inc.|Pilot centered system and method for decluttering aircraft displays|

---

US9340282B2|2014-03-17|2016-05-17|Honeywell International Inc.|System and method for displaying vertical reference on a rotorcraft system|

---

US10037124B2|2014-07-08|2018-07-31|Honeywell International Inc.|Vertical profile display including weather icons|

---

US9473367B2|2014-08-19|2016-10-18|Honeywell International Inc.|Aircraft monitoring with improved situational awareness|

---

US9771081B2|2014-09-29|2017-09-26|The Boeing Company|System for fatigue detection using a suite of physiological measurement devices|FR3048094B1|2016-02-22|2018-03-02|Zodiac Aero Electric|AIRCRAFT INTERFACE AND METHOD OF CONTROLLING SUCH AN INTERFACE|

---

WO2017195133A1|2016-05-11|2017-11-16|Bombardier Inc.|Method of and system for displaying an aircraft control input|

---

FR3055435A1|2016-09-01|2018-03-02|Thales|AVIONIC SYSTEM COMPRISING MEANS FOR CREATING A CLOUD OF DATA AND INTERACTION WITH SAID DATA CLOUD AND ASSOCIATED METHOD|

---

US10394245B2|2016-11-22|2019-08-27|Baidu Usa Llc|Method and system to predict vehicle traffic behavior for autonomous vehicles to make driving decisions|

---

US10019905B1|2017-03-24|2018-07-10|The Boeing Company|Aircraft holding pattern analysis system and method|

---

CN107054370A|2017-05-24|2017-08-18|成都志博科技有限公司|Anti-fatigue-driving system based on eyeball tracking technology|

---

CN109451817A|2017-08-10|2019-03-08|北京小米移动软件有限公司|Unmanned plane cut-in method and device|

---

US10664142B2|2018-05-08|2020-05-26|Honeywell International Inc.|Aircraft data entry system|

---

US20200160731A1|2018-11-16|2020-05-21|Honeywell International Inc.|Method and system for engaging a vertical navigation descent mode for an aircraft|

---

US11270593B2|2019-09-20|2022-03-08|Honeywell International Inc.|Advisory method and system for flight trajectory optimization|

---

US11004347B1|2020-01-15|2021-05-11|Rockwell Collins, Inc.|Looming ball pilot guidance and cuing symbology|

---

EP3859713A1|2020-01-23|2021-08-04|Honeywell International Inc.|Dynamically modifiable parameters in required time of arrivalregions of an assigned flight path|

法律状态:
2015-09-23| PLFP| Fee payment|Year of fee payment: 2 |

---

2016-04-15| PLSC| Publication of the preliminary search report|Effective date: 20160415 |

---

2016-09-28| PLFP| Fee payment|Year of fee payment: 3 |

---

2017-09-29| PLFP| Fee payment|Year of fee payment: 4 |

---

2018-09-28| PLFP| Fee payment|Year of fee payment: 5 |

---

2019-09-27| PLFP| Fee payment|Year of fee payment: 6 |

---

2020-10-13| PLFP| Fee payment|Year of fee payment: 7 |

---

2021-09-30| PLFP| Fee payment|Year of fee payment: 8 |

优先权:

---

申请号 | 申请日 | 专利标题

---

FR1402278A|FR3027127B1|2014-10-10|2014-10-10|TOUCH INTERFACE FOR THE FLIGHT MANAGEMENT SYSTEM OF AN AIRCRAFT|FR1402278A| FR3027127B1|2014-10-10|2014-10-10|TOUCH INTERFACE FOR THE FLIGHT MANAGEMENT SYSTEM OF AN AIRCRAFT|

---

US14/879,796| US10055116B2|2014-10-10|2015-10-09|Tactile interface for the flight management system of an aircraft|

---

CN201510882668.8A| CN105509746B|2014-10-10|2015-10-10|Haptic interface for aircraft flight management system|